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ABSTRACT 

NASA’s Ultra Efficient Engine Technology (UEET) 
program features advanced aeropropulsion technologies that 
include highly loaded turbomachinery, an advanced low-NO x 
combustor, high-temperature materials, intelligent propulsion 
controls, aspirated seal technology, and an advanced 
computational fluid dynamics (CFD) design tool to help reduce 
airplane drag. A probabilistic system assessment is performed 
to evaluate the impact of these technologies on aircraft fuel 
burn and NO x reductions. A 300-passenger aircraft, with two 
396-kN thrust (85,000-pound) engines is chosen for the study. 
The results show that a large subsonic aircraft equipped with 
the UEET technologies has a very high probability of meeting 
the UEET Program goals for fuel-bum (or equivalent CO?) 
reduction (-15% from the baseline) and LTO (landing and 
takeoff) NO x reductions (-70% relative to the 1996 
International Civil Aviation Organization rule). These results 
are used to provide guidance for developing a robust UEET 
technology portfolio, and to prioritize the most promising 
technologies required to achieve UEET program goals for the 
fuel-burn and NO x reductions. 

Keywords: NASA, ultra-efficient engine technologies, 

probabilistic, propulsion svstem analysis, fuel burn, COi, LTO 
NO x 

INTRODUCTION 

Throughout the past century, propulsion innovations were 
the driving force behind the evolution of air transportation. 
Advances in propulsion system technology offer the greatest 
single contribution to the improvement of fuel economy, 
capacity, and the environmental impact of commercial aircraft. 


In the twenty-first century, propulsion will continue to be the 
enabling technology to revolutionize air transportation. To 
maintain the superiority of U.S. aerospace industry into the 21st 
century, and to assist in meeting public demand for safety, 
reliability, environmental compatibility, and affordability, 
NASA initiated the Ultra-Efficient Engine Technology (UEET) 
program in year 2000. 

NASA’s UEET program is designed to revolutionize the 
state of the art in propulsion and propulsion/airframe 
integration technologies with specific objectives to reduce 
aircraft fuel burn (or CO?) and NO x , relative to current engines. 
It features advanced technologies that include: 

Tech ID Technology name 

tech-1 advanced low NO x combustor 

tech-2 highly loaded compressor technology 

tech-3 highly loaded turbine systems 

tech-4 1482 °C (2700 °F) ceramic matrix composite 
(CMC) turbine vane 

tech-5 1482 °C (2700 °F) CMC combustor liner 
tech-6 advanced compressor disk alloy 

tech-7 low conductivity ceramic thermal barrier 
coating (TBC) for turbine airfoils 
tech-8 advanced airfoil alloy development 

tech-9 high Reynolds number (advanced CFD) 

design tool for advanced configuration 
tech- 10 rotating machinery clearance management 
tech- 1 1 high temperature wireless data communication 
tech-12 aspirating seal 
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The NASA UEET Program goals are a 70% reduction in 
landing and take-off (LTO) NO x relative to the 1996 
International Civil Aviation Organization (ICAO) standard and 
a 15% fuel-burn improvement relative to the current state of the 
art large subsonic transports. 

A probabilistic system assessment is performed to evaluate 
the impact of these technologies on aircraft fuel-burn and NO x 
reductions. The statistical approach quantifies the uncertainties 
inherent in these new propulsion technologies and their 
influence on the likely outcomes of engine performance. 
Consequently, it provides additional insight into the risks 
associated with new technologies, which are often needed by 
the decision-makers to determine the benefit and return-on- 
investment of new propulsion technologies. The results are 
used to provide guidance for the development of a robust 
UEET technology portfolio, and to prioritize the most 
promising technologies required to achieve UEET program 
goals for the fuel-burn and NO x reductions. 
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cDF(t)= — ly-'o-^r 1 dt ( 2 ) 


with the transformation 


t= {x-a) 

(, b — a ) 

where the parameters a and b are the minimum and maximum 
values of the variable x, respectively; p and q are the 
distribution shape parameters and B is the beta function defined 
by 


B(p,q) 


np)-r(q) 
r (p+q) 


0 


( 3 ) 


ANALYSIS APPROACH AND PROCEDURES 


Expert Opinion Elicitation 

As Rand analyst E.S. Quade observed about 30 years ago, 
“Intuition and judgment permeate all analysis ... As questions 
get broader, intuition and judgment must supplement 
quantitative analysis to an increasing extent” [1]. Expert 
judgment must be used to judge the risks of emerging 
technology. Obtaining and quantifying input data is probably 
the most crucial part of performing risk assessments. It is a 
crucial but generally overlooked issue [2]. As such, it deserves 
detailed attention. 

For the current assessment, a technology audit scheme 
(TAS) developed by Kirby and Mavris [3] is used to elicit 
opinions from the NASA technologists identified as the focal 
point for each of the UEET technologies. The scheme is based 
on the Delphi method [4], which is a structured process for 
collecting and distilling knowledge from a group of experts by 
means of a series of questionnaires and interviews interspersed 
with controlled opinion feedback. The focus of the TAS is to 
identify the applicable set of UEET technologies for the vehicle 
of interest, gather the required information, and compile the 
data necessary for the system analysis. The process is described 
in detail in reference [5]. 

The Beta Distribution 

Based on the information obtained from the technologists, 
the 3-point estimates (maximum, minimum, and most-likely 
values) of the impacts (positive and/or negative) for each of the 
technologies are quantified. They are summarized in Table 1 . A 
four-parameter beta distribution is then created for each of the 
technologies. The probability density function (PDF) of the 
beta distribution is 


= 1 {x-a) p \b-x) q 1 

%?) (b-a) p+q ~ l 


( 1 ) 


and the cumulative density function (CDF) is 


The shape parameters p and q depend on whether the mode 
(most-likely value) is to the left or right of the midrange. They 
are determined using the method described in [6]. The resulted 
mean and standard deviation of the impact for each of the 
technologies are also summarized in Table 1 . 

The CDFs (eq. (2)) are calculated numerically. All three 
equations are implemented into the Fast Probability Integration 
(FPI) computer code [7], and are used to perform the 
probabilistic system analysis of the UEET technologies. 

System Analysis 

The approach taken in this effort is to combine 
thermodynamic cycle analysis using NPSS (Numerical 
Propulsion System Simulator) [8], engine weight estimation 
using WATE (Weight Analysis of Gas Turbine Engines) [9], 
aircraft mission sizing using FLOPS (Flight Optimization 
System) [10], and FPI. A schematic of the integrated 
approached is shown in Figure 1. 

The computer code NPSS is used to calculate engine 
thrust, specific fuel consumption and LTO NO x emissions. The 
engine weight is calculated by the WATE code. The results 
from NPSS and WATE are used by FLOPS for performing 
airplane mission and sizing analyses, and ultimately calculates 
the fuel-bum based on a 5556-kilometers (3000 nautical miles) 
economic mission. 

Probabilistic Analysis 

All probabilistic analysis methods are approximate. Monte 
Carlo simulation, which is oftentimes referred to as the “exact” 
solution, is actually an approximate because a finite number of 
samples are always used. Thus, the nature of the approximation 
is one of “lack of data”, which can be reduced by increasing the 
number of samples. However, for large-scale high fidelity 
problems, the inefficiency of Monte Carlo simulation renders it 
impractical for use. Many efficient methods have been 
developed to alleviate the need for Monte Carlo simulation. 
These methods include the first and second-order reliability 
method (FORM and SORM) [11], the advanced mean value 
family of methods (AMV) (12], and the response surface 
method (RSM) [13]. These methods replace the original 
deterministic model with a computationally efficient analytical 
model in order to speed up the analysis. 
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Table 1 . — UEET technologies and their uncertainties for a large subsonic transport (based on year -2003 technology audit). 
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of advanced airfoil alloy development technology (tech-8). 





Sensitivity factors Response cumulative 

distribution function (CDF) 

Figure 1.— Fast probability integration input/output schematic. 


For the current assessment, an advanced first-order 
reliability method is used. This method, based on the most- 
probable-point (MPP) concept, is one of the several methods in 
the FPI code. The code was developed under contract with 
NASA Glenn Research Center [14]. The role of FPI is to 
perform probabilistic analysis utilizing the results generated by 
NPSS, WATE, and FLOPS. The results are generated in the 
form of cumulative distribution functions (CDFs). 

In addition, FPI is used to perform sensitivity analyses to 
rank the technologies in order of their impact on engine fuel 
burn and LTO NO x emissions. Sensitivity values could be + or 
- in nature. For the current assessment, a positive value 
indicates that the technology has positive impact on fuel burn 
(or LTO NO x ) reduction and a negative value has the opposite 
effect. Technology with the highest absolute sensitivity value is 
defined to be the most influential technology. The technology 
with the second highest absolute sensitivity value is the second 
most influential technology and so on. This approach ranks the 
technology in the order of their influence on engine 
performance (i.e., fuel burn or LTO NO x reductions). The 
sensitivity information thus obtained from FPI is very useful 
from the design point of view. For example, engine 
performance reliability can be improved when uncertainties in 
the most influential technologies are reduced. Those 
technologies that do not have significant influences 
deterministically could nevertheless have strong influences on 
engine performance reliability if these technologies have huge 
uncertainties. Weak technology with large uncertainties may 
have probabilistic sensitivity factors more important than 
strong technologies with small uncertainties. Unlike 
deterministic analysis, sensitivity factors in probabilistic 
analysis are functions of both the deterministic sensitivity and 
the uncertainty (characterized by the standard deviation). 


LTO NOx Definition 

The correlation used for the current LTO NO x calculation 
is based on flame-tube tests [15,16] and is defined as 

K(P t3 )°' 5945 exp[(Tt 3 -459.67)(0.002867)] x 
(FAR/delphi) 1 ' 6876 [( l _ P t4 /P t3 )xl00]-°' 5651 (4) 

where 

K technology constant 

P,3 combustor inlet total pressure 

P t4 combustor exit total pressure 

T t3 combustor inlet total temperature 

FAR fuel air ratio 

delphi 1 - fraction of combustor inlet air used for liner cooling 

RESULTS AND DISCUSSION 

It is critical to assess the reliability of a new propulsion 
system because of inherent design uncertainties in the UEET 
technologies. The current assessment focuses on the technical 
aspect of engine performance, i.e., mission fuel-burn and LTO 
NO x emissions. The results are presented in the form of 
cumulative distribution functions (CDFs) and probabilistic 
sensitivities. A CDF gives a relation between a value up to 
certain magnitude of a response variable (fuel-burn or LTO 
NOx) and the probability of its occurrence. The results are 
relative to those of the current state-of-the-art 300-passenger 
airplane (baseline). 

The results show that, the current portfolio of UEET 
technologies provides a greater than 99% confidence in 
meeting the UEET Program goal of 70% below the current 
LTO NO x rule, while the fuel-bum goal (15% reduction) can be 
met with 97% confidence. The confidence levels indicate the 
risk of not meeting the UEET Program goals is very low for the 
fuel-bum and almost none for the LTO NO x emissions. The 
results are shown in Figures 2 and 3. 
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LTO NO x , % (relative to current ICAO rule) 


Figure 2. — Cumulative distribution function (CDF) of engine landing 
and takeoff (LTO) NO x emissions. 



Fuel burn, % (relative to the baseline engine) 

Figure 3. — Cumulative distribution function (CDF) of engine fuel burn. 

LTO N0 x Sensitivity ratio which also increases the combustor inlet air temperature. 

The sensitivity of LTO NO x to the twelve technologies, at That effect alone, assuming all other engine aspects are 

99% probability level is shown in Figure 4. As expected, it unchanged, will increase the LTO NO x emissions, 

shows that the advanced low-NO x combustor (tech-1) has the 

dominant impact on the LTO NO x emissions. It implies that to Fuel Burn Sensitivity 

reduce the LTO NO x emissions beyond the UEET goal, the For the fuel-burn reduction, the sensitivity result at 97% is 

biggest payoff is to focus on the combustor technology. Other shown in Figure 5. It shows that the Highly loaded turbine 

technologies have minimal or no impact on the LTO NO x systems (tech-3), Highly loaded compressor technology (tech- 

emissions. Among all the technologies, the Advanced 2), and the high Reynolds number design tool for advanced 

compressor disk alloy (tech-6) is the only one that has a configurations (tech-9) are the three most influential 

negative impact (though small) on the LTO NO x . This technologies. The influences of Advanced compressor disk 

technology enables the increase in the engine’s overall pressure alloy (tech-6), Low-conductivity thermal barrier coating for 
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UEET technology 


Figure 4. — Sensitivity of engine landing and takeoff (LTO) NO x emissions. 



UEET technology 


Figure 5. — Sensitivity of engine fuel burn. 


turbine airfoils (tech-7), and Rotating machinery clearance 
management (tech-10) are moderate. Other technologies have 
minimal or no impact on the fuel-bum reduction. 

Among these six top-ranking technologies, tech-6 and 
tech-7 are material technologies. It is noted that tech-7 and 
tech-8 (Advanced airfoil alloy development) provide the same 
type of benefit, enable the amount of turbine cooling to be 
reduced. However, according to the expert opinion (see Table 
1), tech-7 enables more cooling flow reduction. As a result, 
tech-7 has a much higher impact on the fuel burn. Another 
coolant-reduction technology, tech-4 (1482 °C CMC turbine 
vane), has insignificant impact on the fuel burn, relative to 


tech-7 and tech-8. This is because tech-4’s coolant reduction 
comes primarily from the first turbine vane (i.e., non- 
chargeable cooling) which is not as advantageous as a reduction 
in chargeable cooling (as for tech-7 and tech-8). Overall, the 
current results show that advanced materials are the key 
enablers for meeting the UEET Program goals. 

The results also implies that an alternative approach to 
satisfy the UEET Program goals is to focus on the development 
of the six largest fuel-bum reduction technologies plus, the 
Advanced low-NO x combustor (tech-1). By reducing the 
uncertainties of these six technologies by 25%, and by keeping 
the uncertainty of tech-1 the same, while assuming other 
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technologies provide only minimum impacts/benefits (from the 
3 -point estimates), the probability of meeting the UEET fuel- 
burn goal exceeds 99%, as shown in Figure 6. In fact, this 
technology portfolio enables a greater than 99% probability of 
exceeding the UEET fuel-bum goal, with 16.5% fuel-burn 
reduction relative to the baseline. This is achieved without 
sacrificing the LTO NO x goal, as shown in Figure 7. 


It is noted that, in a recent independent review of NASA’s 
Aeronautics Technology Programs performed by the National 
Research Council, these seven technologies, together with tech- 
8 {Advanced airfoil alloy development ) have been rated either 
world-class or exceptionally good technologies [17]. 
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0.4 b 


0.2 b 


0.0 


1 I I I I I 

— Focus on 7 highly-ranked technologies 

(-25% uncertainties on 6 low-fuel-burn technologies; 
uncertainty unchanged for the low-NO x technology) 


All technologies considered 


_L 





T*-— 

v- Exceeds 99% 
probability 
of meeting 
UEET goal 

Exceeds 99% 
probability 
of exceeding 
UEET goal 


-21 -20 -19 -18 -17 -16 -15 -14 

Fuel burn, % (relative to the baseline engine) 

Figure 6. — Impact of uncertainty-reduction on engine fuel burn. 


-13 



Figure 7. — Impact of uncertainty-reduction on landing and 
takeoff (LTO) NO x emissions. 
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CONCLUSIONS 

Based on the current assessment results, the following 
conclusions are made: 

(1) A large subsonic aircraft equipped with the UEET 
technologies has a very high probability of meeting 
the UEET Program goals for fuel burn and LTO NO x 
reductions, over 96%. 

(2) The top-seven UEET technologies for fuel-burn or 
C0 2 reduction are: 

a. Highly loaded turbine system 

b. Highly loaded compressor 

c. High Reynolds number design tool for 
advanced configuration 

d. Low conductivity ceramic thermal barrier 
coating for turbine airfoils 

e. Advanced compressor disk alloy 

f. Rotating machinery clearance management 

g. Advanced airfoil alloy development 

(3) A technology that enables significant non-chargeable 
coolant reduction (such as 1482 °C CMC turbine 
vane) is not as advantageous as those that enable 
significant chargeable coolant reduction (such as Low 
thermal conductivity ceramic TBC for turbine airfoils 
and Advanced airfoil alloy development ), for fuel burn 
reduction. 

(4) The Advanced low NO x combustor technology has the 
most and dominant impact on the LTO NO x 
reductions. 

(5) Advanced materials are key enablers for meeting the 
UEET Program goals. 

(6) The UEET Program goals can be exceeded with high 

probability by focusing on the top-ranking 

technologies and reducing their uncertainties. 

(7) An effective expert opinion elicitation process, or 

technology audit, is crucial for performing 

probabilistic assessment. A process that includes both 
the experts from NASA and the engine industry will 
ensure the audited data are indeed reasonable 
representation of each of the technologies’ potential. 

(8) The probabilistic approach provides a more realistic 
and systematic way to assess advanced propulsion 
technologies, because it accounts for their inherent 
uncertainties. 
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